2D and 3D Multimodal Hybrid Face Recognition
نویسندگان
چکیده
We present a 2D and 3D multimodal hybrid face recognition algorithm and demonstrate its performance on the FRGC v1.0 data. We use hybrid (feature-based and holistic) matching for the 3D faces and a holistic matching approach on the 2D faces. Feature-based matching is performed by offline segmenting each 3D face in the gallery into three regions, namely the eyes-forehead, the nose and the cheeks. The cheeks are discarded to avoid facial expressions and hair. During recognition, each feature in the gallery is automatically matched, using a modified ICP algorithm, with a complete probe face. The holistic 3D and 2D face matching is performed using PCA. Individual matching scores are fused after normalization and the results are compared to the BEE baseline performances in order to provide some answers to the first three conjectures of the FRGC. Our multimodal hybrid algorithm substantially outperformed others by achieving 100% verification rate at 0.0006 FAR.
منابع مشابه
Hybridization of Facial Features and Use of Multi Modal Information for 3D Face Recognition
Despite of achieving good performance in controlled environment, the conventional 3D face recognition systems still encounter problems in handling the large variations in lighting conditions, facial expression and head pose The humans use the hybrid approach to recognize faces and therefore in this proposed method the human face recognition ability is incorporated by combining global and local ...
متن کاملRobust Facial Data Recognition using Multimodal Fusion Features in Multi-Variant Face Acquisition
Biometric use physiological traits such as fingerprints, face and behavioral traits such as voice, hand signatures characteristics to verify an individual’s identity. The two process involved in biometrics are verification and identification. Verification process is performed by matching an individual’s biometric with the template of claimed identity only. The identification process performed b...
متن کاملPose - Invariant Multimodal ( 2 D + 3 D ) Face Recognition using Geodesic Distance Map
In this paper, an efficient pose-invariant face recognition method is proposed. This method is multimodal means that it uses 2D (color) and 3D (depth) information of a face for recognition. In the first step, the geodesic distances of all face points from a reference point are computed. Then, the face points are mapped from the 3D space to a new 2D space. The proposed mapping is robust under th...
متن کاملHow Much Face Information Is Needed?
Multimodal 2D+3D face biometrics commonly report that performance improves relative to that of a single modality. Complete 2D and 3D data can be available during training because they are acquired in a controlled scenario. However, in the evaluation scenario, only partial 2D and 3D data can be acquired and hence available for recognition. In this paper we present experimental results that deter...
متن کاملComparison of 2D/3D Features and Their Adaptive Score Level Fusion for 3D Face Recognition
3D face has been introduced in the literature to deal with the unsolved issues of 2D face recognition, namely lighting and pose variations. In this paper, we study and compare the distinctiveness of features extracted from both the registered 2D face images and 3D face models. Sparse Representation Classifier (SRC) is exploited to calculate all similarity measures which are compared with the on...
متن کامل